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Abstract 

On the standard microscopic model of friction we confirm the com- 
mon belief that the irreversible entropy production originates from the 
increase of Shannon information. We reveal that the reversible micro- 
scopic dynamics would continuously violate the Gibbsian interchange- 
ability of molecules. The spontaneous restoration of interchangeability 
constitutes the mechanism of irreversibility. This is the main sugges- 
tion of the Letter. We also point out that the irreversible entropy can 
partially be rescued if the size of the medium is finite. The rescue- 
able entropy is found to be proportional to the square of the Fisher 
statistical (also called thermodynamic) distance. 

Introduction. It is commonly trusted that the thermodynamic entropy 
produced in irreversible processes is identical to the increase of the Shan- 
non information in the underlying microdynamic process. A direct proof 
is yet missing. The microscopic dynamics is reversible, it preserves the 
Shannon information. We need a transparent model to resolve this funda- 
mental paradox. In this Letter I discuss the mechanical friction of a thin 
'disc' perpendicularly driven through a medium with small velocity V. The 
phenomenological model is a prototype for the whole theory of irreversible 
processes Q. Accordingly, the disc moves against the frictional force — rjV 
where rj is the friction constant. If the medium (reservoir) is in thermal equi- 
librium at inverse temperature (3 then the rate of thermodynamic entropy 
production can be written in this form: 

S = vPV 2 . (1) 

An elementary microscopic model will be considered where the medium is 
ideal gas of light molecules scattering elastically on both flat surfaces of 
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the disc. This is the Brownian motion microscopic model well-known from 
textbooks Q, applied this time to a disc instead of a 'ball' ||. The model 
enables us to calculate the exact reversible evolution of the microscopic sys- 
tem. I will confirm that the thermodynamic entropy production rate (|I|) 
can indeed be identified as the rate I of Shannon information increase in an 
infinite medium: 

i = s, (2) 

if the molecular inter changeability, which is being violated by each reversible 
collision on the disc, is being re-imposed (d la Gibbs). This appears to be a 
generic mechanism of irreversibility in the otherwise reversible dynamics. 

The molecular interchangeability is less relevant if the medium is finite. 
Then, as we shall prove, the increase of Shannon information becomes less 
than the standard irreversible entropy production ([l]): 

I = S S resc . (3) 

In the given microscopic model, the rate of the rescued information (and 
entropy) will take the following form: 

Sresc = Iresc — \S , (4) 

where S is the standard irreversible entropy production rate (|l]) and the 
rescue factor \ is the ratio of the already interacted molecules within the 
whole reservoir. 

Shannon information. Let the medium be ideal gas of ./V identical 
molecules of mass m. The initial distribution of the momenta pi, ■ ■ ■ ,pn 
is the thermal equilibrium distribution at inverse temperature f3: 



Po(pi, ■ ■ ■ ,Pn) = exp 



B N ' 
2m^ Pr 

r=l 



(5) 



The molecules collide on the disc elastically (reversibly) . The mean inter- 
collision time r is assumed to be independent of V which is a good approx- 
imation for small velocities V. In a single collision, the momentum change 
of the given molecule is approximately the following: 

p r — > 2mV — 2p r , (6) 

provided the molecules are much lighter than the disc. In a short yet macro- 
scopic interval At ^> r, the average momentum transfer to the medium is 
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2mVAt/T. Therefore the average fractional force is —2mV/r while the fric- 
tion constant takes this simple form: 



r, = — . (7) 

(For simplicity, we request that no molecules will scatter twice or more. It 
also means that the mass of the medium is being consumed by the collisions 
at rate r]/2. Then, in a finite reservoir of mass Mr = Nm, the friction 
process would be cut at time 2Mji/r].) 

After time At, the equilibrium distribution is shifted: 

PAt&l, ■ ■ ■ ,Pn) =PoOl ~pi,...,PN ~Pn) , (8) 

where p r is the mean momentum transfer caused by collision to the r'th 
molecule. Obviously, the Shannon information has been preserved by the 
collisions. On the other hand, we know from the thermodynamics of friction 
that there is a definite entropy production ([!]). We suspect that an ultimate 
information increase comes from the undistinguishability of the molecules. 
We assume that knowledge is leaking out, regarding which molecule scattered 
on the disc and which did not. Accordingly, the true distribution p&t of 
the medium must be the re-symmetrized projection of the post-collision 
distribution (|8|) over all permutations 7r of the N molecules: 

PAt{Pl,---,PN) = M^2pa(Pir(l) ~ Pi, ■ ■ ■ >Pn(JN) ~ Pn) • (9) 

7T 

We define the increment of the Shannon information (counted in ln2 bit 
units) during the interval At: 

f d N p 
A/ = - J [pAtlnpAt - Polnpo] (27rm/?)jV/2 • (10) 

Using the Eqs.(|5[^), I have derived the Taylor-expansion upto the lowest 
non-vanishing order of the momentum transfers: 
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(11) 



The two terms on the R.H.S. correspond to macroscopic quantities. There 
are two relationships, respectively. The first is the balance between the 
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average energy increase of the medium and the energy dissipated by the 
friction force: 

1 N 

— J2Pr = vVxVAt. (12) 
Similarly, there is an average momentum balance as well: 

N 

^2p r = rjV x At . (13) 
r=l 

Let us insert the above two relationships into (|ll]), yielding the following 
rate of information increase: 

This is the central result of the Letter. It confirms the equality (|2|) of 
irreversible information fll4| ) and entropy (|l|) productions in infinite mass 
reservoirs (Mr = Nm = oo). 

Information rescue. In a finite reservoir, the Eq.(|l4|) contains a non- 
stationary correction, we call it the rescued information. Its rate reads: 

^£££ =r?/3F 2^ (15) 
A* ' 2Mr v ' 

This equation is equivalent with the Eq.(Q) if we set \ — 2Mr which is 
indeed the ratio of the consumed mass of molecules to the total mass of 
the reservoir. In conventional system-reservoir setups the mass Mr of the 
reservoir is kept constant. Yet we can consider non-static setups where 
the reservoir mass is allocated dynamically, i.e., varying with time. We shall 
therefore introduce a monotone function Mr{€) with fixed initial Mr(0) = 
and final values Mn(ttot) = Mjt to t, where ttot is the total considered time 
of the process. (The allocation rate Mr should never fall below the con- 
sumption rate Mr > 77/2. In the rest of the Letter we shall understood this 
condition, without mentioning it again.) The function Mr(£) will govern 
the gradual allocation of the medium to the friction process. A discretized 
interpretation is the following. We divide the total time and reservoir into 
small yet macroscopic parts. In each short interval [t, t + At] in turn, a 
small part AMr(£) = Mr(£ + At) — Mr{€) of the total mass Mr 4o4 is used 
as medium: the small medium is brought into contact with the disc at the 
beginning of the small period and removed at the end of it, to be replaced 
by the forthcoming small medium e.t.c, until the whole period [0, ttot] an d 
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the total reservoir mass Mjitot are both exhausted. To the first short period 
[0, At], in particular, we allocate a small mass M#(A£) ~ Mr(0)A£. Substi- 
tuting Mr by Mn(0)At, the rate ( |l5| ) of the rescued information becomes 
stationary on the macroscopic time scale: 

Uesc = VPV 2 -^- . (16) 

2Mr 

We can extend this differential relationship for all later time. Invoking the 
Eq.(|4|), we can read out the rescue factor for the case of time-dependent 
reservoir allocation: 

X = -^-- (17) 
2M R 

This is the ratio of the reservoir's consumption rate r//2 with respect to its 
allocation rate Mr. 

An optimization of the rescued information (entropy) is straightforward. 
We are going to maximize the total rescued information: 

Iresc = S resc = rjl3 V 2 -l-dt , (18) 
Jo 2Mr 

by varying Mr{€) at fixed total reservoir mass Mjitot- The Euler-Lagrange 
equation yields Mr = const x V. The optimum reservoir allocation Mr{€) 
is thus proportional to the length J* Vdt of the disc trajectory. We should 
allocate equal reservoir masses over equal lengths of the driven trajectory of 
the disc. For the special case of stationary driving V = const, the optimum 
allocation is also stationary: Mr = MRt t/tt t- The optimum ratio ( |T7| ) of 
the rescued/standard information (entropy) takes this form: 

ZMRtot 

Reservoir-driven process. We apply our results to the case when we do 
not directly drive the disc. Rather we change slowly the velocity Vr(£) of 
the medium and only the frictional force — r/(V — Vr) will drive the disc. All 
previous equations remain valid if V is substituted by V — Vr which can be 
further expressed from the Newton equation MV = —T)(V — Vr) where M 
is the disc mass. The resulting substitution has thus to be V — > —^j-V. The 
thermodynamic entropy production rate (|]) takes this form: 

M 2 

S = (3—V 2 , (20) 
V 
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and for the rescued information (entropy) rate ( |l6| ) we obtain: 



i resc = (3M 2 V 2 ^^ . (21) 
2M R K ' 

It is remarkable that the friction constant rj canceled! The rescued informa- 
tion in the reservoir-driven process is universally independent of the tempo- 
ral scales. (The rescue factor x will, however, keep its ^-dependence (|l7|).) 
The optimization of the rescued information (entropy) is again straightfor- 
ward. We minimize the total rescued information: 

Iresc = S resc = (3M 2 f t0t V 2 -^-dt (22) 
Jo 2Mr 

at fixed total reservoir mass Mjnat- The variation of the allocation func- 
tion Mfi(t) yields the condition Mr = const x V . The optimum reservoir 
allocation Mji(t) is proportional to the velocity change V(t) — V(0) of the 
disc. For the special case of constant acceleration V = const, the optimum 
allocation is stationary: Mr = MR to t/t to t- The optimum rescue factor is 
the same (|i~9| ) as for the externally driven disc. 

Finally we give an explicit interpretation for the 'timelessness' of the 
rescued information (fH]). We note that the velocity V of the reservoir- 
driven disc is an equilibrium thermodynamic variable itself. It is tending to 
equilibrate with the medium's velocity Vr. In equilibrium it has a definite 
fluctuation oy which is also a thermodynamic quantity: a 2 ? = 1/(3M. This 
gives rise to the notion of statistical length £ § , also called thermodynamic 
length g: 

M = — , (23) 
cry 

rescaling the parameter length dV in absolute units of equilibrium thermo- 
dynamics. Let us express the evolution in function of the statistical length 



£ instead of the time t. Replacing (21), we obtain the following result for 
the rescued entropy rate: 

I' = S' = M (241 

*resc — ^resc 2iW' ' 

where the apostrophes stand for ^-derivatives. The maximum of the rescued 
entropy is obtained by variation of the reservoir allocation function Mr(£) 
between the fixed endpoints. The resulting optimum is Mr{£) = const x £. 
In the thermodynamic length, the optimum rescued entropy rate ( p4|) is 
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constant and the total rescued entropy becomes a simple quadratic function 
of the total statistical length: 



Iresc — S resc — £ tot . (25) 

It depends exclusively on the equilibrium thermodynamics of the disc-reservoir 
fractional interaction. 

Discussion. On the common microscopic model of friction we have 
pointed out that the standard thermodynamic entropy production derives 
exactly from the increase of Shannon information. The well-known discrep- 
ancy with the microscopic reversibility has been resolved in a natural way. 
The resolution comes from a related discrepancy, revealed by the Letter: 
The microscopic model is inevitably violating the Gibbsian interchangeabil- 
ity of molecules. The recovery, i.e., the re-symmetrization of the phase- 
space density is obviously irreversible. This is the mechanism of Shannon 
information increase and of macroscopic entropy production. (The role of 
interchangeability in the irreversibility of system-reservoir interactions has 
independently been noticed for a quantum informatic model of non-thermal 
equilibration by Ziman et al. ||.) The first proof of perfect coincidence 
between the Shannon information and the phenomenological entropy pro- 
duction in a common irreversible process has been achieved by the present 
Letter. The phenomenology of friction is structurally identical to the model 
of general irreversible processes [y. We therefore incline to think that our 
results reflects general features of irreversible processes. 

We have also shown that the information increase falls with the size of 
the medium. A certain portion of the standard entropy production can thus 
be rescued in finite reservoirs. The Gibbsian molecular interchangeability, 
having been violated locally, will be recovered by a process propagating in 
space. The identity of the distinguished molecules (i.e. of those which 'took 
part' in friction) will be smashed gradually over bigger and bigger parts of 
the surroundings. It is clear that this propagation is cut by the walls of the 
reservoir though temporal aspects (if any) of the propagation have not been 
discussed at all. 

Entropy rescue might remain pure speculation for static reservoirs. The 
Letter has discussed time-dependent reservoir allocations. An externally 
driven 'object' in a medium at rest as well as an object driven merely by the 
frictional force in a moving medium have been considered. The optimum 
reservoir allocation is proportional to the real length of the object trajectory 
in the first case, and to the statistical (thermodynamical) length in the 
second case. The second result gives an exact microscopic interpretation 
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for the role of thermodynamic length in irreversible process optimization. 
This may be a crucial step in the longstanding complex research 0, ||, 0] 
to illuminate the significance of Fisher's statistical distance in statistics, 
control, thermodynamics, and quantum information. 
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